Brain and Language
○ Elsevier BV
Preprints posted in the last 90 days, ranked by how well they match Brain and Language's content profile, based on 11 papers previously published here. The average preprint has a 0.01% match score for this journal, so anything above that is already an above-average fit.
Sekine, K.; Okuma, R.; Ban, H.
Show abstract
People frequently gesture while speaking, even when listeners cannot see them--for instance, during phone calls or behind barriers. Congenitally blind individuals also gesture, indicating that gestures serve functions beyond visual communication. Previous models of gesture production (e.g., Kita & Ozyurek, 2003; Rauscher et al., 1996) suggest that gestures facilitate speech, but they rely heavily on behavioural data and provide limited insight into temporal dynamics. This study used magnetoencephalography (MEG), a neuroimaging technique with high temporal resolution, to investigate when gestures influence speech. Twenty-three native Japanese speakers took part in a storytelling task under two conditions: Gesture-Required (gesture use instructed) and Gesture-Prohibited (hands kept still). Participants described cartoon clips across multiple sessions (30 trials x 3 sessions per condition). Using speech onset as the reference point, we compared root mean square (RMS) values within a -0.25 to 0 second window. RMS values were higher in the Gesture-Prohibited condition, with increased activity in the bilateral anterior temporal lobes (Left ATL: p = .049; Right ATL: p = .027), but not in motor regions (p = .29). These findings suggest that gestures reduce neural load in language-related regions before articulation. Co-speech gestures may support speech planning by facilitating lexical retrieval or semantic structuring. The lack of motor region effects indicates that this influence is linguistic rather than motoric. This study provides direct direct neurophysiological evidence of the timing of gesture-speech interaction, supporting models that view gestures as an integral part of speech production.
Coutinho, M. R.; Eden, G. F.; Brignoni-Perez, E.; Jamal, N. I.
Show abstract
Prior studies in bilinguals have reported relationships between brain structure and the dimensions of (i) language proficiency or (ii) language balance (the discrepancy between a bilinguals two proficiencies), but rarely both, even though they are highly related. These studies were often conducted in late bilinguals and the analyses limited to regions of interest. Here, we tested for relationships between brain structure and these two dimensions in 46 early cultural Spanish-English bilinguals (mean age = 16.7 years) at the level of the whole brain for gray matter volume (GMV) and cortical thickness (CT). Results revealed a positive association between GMV and proficiency in the weaker language in the right angular gyrus (AG; BA 39) extending into the superior temporal gyrus (BA 22). More balanced bilingualism was also associated with more GMV in the AG (BA 39), in addition to less GMV in left postcentral gyrus (BA 1), right cerebellum lobule IX and right superior occipital gyrus (BA 18). However, these relationships between GMV and balance disappeared after controlling for language proficiency. No significant associations were observed for CT and these two dimensions of language. Our findings suggest that relationships between GMV and balance are driven by language proficiency, and that the relationship between GMV and language proficiency likely does not involve language-specific mechanisms, given the location of the association is in the right inferior parietal cortex. Together, this study separates the neuroanatomical bases of these two language dimensions and places them in brain regions outside those usually targeted in prior studies. HighlightsO_LINeuroanatomy was correlated with proficiencies in early Spanish-English bilinguals C_LIO_LIRight angular gyrus gray matter volume (GMV) was positively related to proficiency C_LIO_LIGMV was positively related to balance, but not after controlling for proficiency C_LIO_LIRelations with these language dimensions are located outside of language cortex C_LIO_LINo significant associations were observed for cortical thickness C_LI
Hooper, J.; Dengler, J.; Basilico, D.; Nelson, M. J.
Show abstract
Sentence comprehension requires the incremental construction of syntactic structure and semantic interpretation. Prior neural work (Nelson et al., 2017) identified key neural events at major phrase boundaries during sentence comprehension. To investigate a behavioral correlation of these processes, we used self-paced reading to examine the impact of syntactic phase boundaries, semantic congruence, and sentence structure on sentence processing. Participants read object-relative, subject-relative, and canonical control sentences one word at a time and a subsequent comprehension task. Reading times were analyzed relative to phrase boundaries, node-closing operations, and semantic congruence. Object-relative sentences produced the greatest processing difficulty, demonstrated by increased reading times and decreased comprehension accuracy. Reading times peaked at the phrase boundaries, indicating that processing costs are tied to constituent completion rather than individual lexical categories. Reading times also increased with the number of syntactic constituents completed at a phrase boundary. Agent-patient semantic congruence produced its largest effects in object-relative sentences, suggesting that semantic information interacts with syntactic computations when processing demands are greatest. These findings demonstrate that self-paced reading is sensitive to the incremental processing associated with syntactic constituent completion. Processing costs are tied more closely to phrase completion than to individual lexical categories, scale with the amount of syntactic structure completed at a boundary and interact with agent-patient semantic interpretation during object-relative sentence comprehension. Together, these findings support a view of sentence comprehension in which syntactic structure building and semantic interpretation proceed incrementally and interact continuously throughout online language processing.
Lam, T. K.; Huo, S.; Lui, F. H. K.; Mcbride, C.; Maurer, U.
Show abstract
In school-aged children, resting-state posterior alpha activity has been linked to thalamocortical signal coordination and literacy-related cognition. However, findings are mixed, partly because conventional band power measures conflate oscillatory (periodic) activity with the broadband aperiodic (1/f) background. We tested Chinese-English bilingual children in Grades 1 to 5 (N = 121; 72 families; mean age = 8.23 years, SD = 0.81) to examine if posterior periodic alpha power (8-12 Hz), isolated from aperiodic components, predicts foundational biliteracy skills (Chinese and English word reading and dictation). We also tested whether Chinese digit rapid automatized naming (CDRAN) mediates these associations. In regression models that accounted for family clustering and controlled for age, socioeconomic status (SES), and aperiodic components (exponent and offset), higher periodic alpha power uniquely predicted better performance on all four literacy outcomes. In structural equation models that accounted for family clustering, periodic alpha power predicted CDRAN ({beta} = .213, p = .011), and CDRAN significantly predicted Chinese word reading ({beta} = .442, p < .001), Chinese dictation ({beta} = .346, p = .003), English word reading ({beta} = .302, p < .001), and English dictation ({beta} = .349, p < .001). Indirect effects via CDRAN were significant for all outcomes. These findings suggest that aperiodic-adjusted periodic alpha power is associated with biliteracy variation across Chinese and English and that its association with biliteracy operates in part through rapid serial naming efficiency.
Shalu, S.; Muralikrishnan, R.; Schlesewsky, M.; Bornkessel-Schlesewsky, I.; Choudhary, K. K.
Show abstract
The present study examined whether thematic reversal anomalies are processed similarly across subject and object experiencer constructions in Malayalam. Event-related brain potentials (ERPs) were recorded as 30 first-language speakers of Malayalam read transitive sentences with the two types of experiencer verbs, in which the thematic role assignment for the preceding arguments was either correct or reverse. The reversal anomaly became apparent only at the position of the experiencer verb. A linear mixed-models analysis confirmed a biphasic N400-P600 effect at the verb for both verb types when the argument roles were reverse. Thus, our results suggest a uniform processing strategy for TRAs irrespective of the type of experiencer verb involved. However, the N400 amplitude was larger for the object experiencer verb compared to subject experiencer verbs. We suggest that the quantitative difference observed for object experiencer verbs is due to the inverse linking of grammatical function and thematic roles associated with these verbs. In other words, verb-specific linking properties modulate the processing of TRAs involving object experiencer verbs. We argue that this modulation occurs because the parser recalibrates cue weighting when the expected form-to-meaning mappings are overridden by the inverse linking properties of object experiencer verbs.
Andrade, K. D.; Melton, D. L.; Ries, S. K.
Show abstract
Language production requires the coordination of multiple cognitive processes. The ability to anticipate and override a habitual response in favor of a contextually-appropriate response are key subprocesses of cognitive control which enable speakers to communicate effectively. Word retrieval involves the co-activation of semantically related alternatives from which the speaker must select the appropriate target representation. Although cognitive control mechanisms have been proposed to contribute to resolving semantic interference during language production, the nature of these control processes remain unclear. Studies investigating the temporal dynamics of cognitive control during decision making tasks have led to a distinction between two operating processes: proactive control, initiated prior to the occurrence of conflict, and reactive control recruited after conflict is detected. We investigated the roles of proactive and reactive control in resolving interference between competing linguistic representations during word retrieval. We analyzed congruency sequence effects combined with delta-plot distributional analyses to dissociate potential adjustments in proactive versus reactive cognitive control in a picture-naming task manipulating semantic context compared to a minimally-linguistic Stroop-like paradigm. Reaction time distributional properties following semantically related trials revealed the engagement of proactive control in semantic interference resolution during word retrieval in the PWI task. In contrast, reactive inhibitory control was engaged in resolving semantic interference following low conflict trials. This distinction was not present in the minimally-linguistic task, which did not appear to engage adaptive control to the same extent. These findings demonstrate that both proactive and reactive cognitive control mechanisms contribute to language production, and are engaged dynamically, adjusting trial-by-trial to resolve semantic interference during word retrieval. In addition, our study provides important insight into the comparison of language with other cognitive domains and positions linguistic paradigms as being instrumental in the study of cognitive control dynamics.
XU, M.; REN, Y.
Show abstract
Building upon foundational psychological theories of event segmentation, this study addresses the limitation of overreliance on temporal boundaries as the primary segmentation criterion. Drawing on two experiments of direct and indirect causation in Mandarin Chinese, this study demonstrates how cognitive segmentation granularity and semantic integration jointly shape syntactic encoding. Results reveal distinct event encoding patterns for direct and indirect causation: coarse-grained segmentation leads to compact syntactic structures (e.g., verb-resultatives), while fine-grained segmentation yields varied multi-clausal expressions. Chinese speakers update event models via prediction errors of intentionality and protagonists, and tend to establish event boundaries at goal-relevant action endpoints when construing causal chains. These conceptual dimensions exert a modulating influence on both event segmentation and semantic integration. We propose a triad model integrating event segmentation, semantic integration, and linguistic specificity, providing a unified framework for elucidating the mind-language interface in conceptual construction and event coding of causation.
Wang, J.; Guo, T.; Bozic, M.
Show abstract
Language experience is a powerful driver of neurocognitive plasticity, shown to modulate attentional and executive processing in speakers of multiple languages. This paper investigated how immersion in a second-language environment shapes attentional processing of speech. Fifty-eight bilingual Chinese-English speakers matched on their English language proficiency listened to competing continuous speech streams in a naturalistic listening task. They were immersed either in their native language environment (Beijing, China), or in the second language environment (Cambridge, UK). In an identical EEG experiment across the two immersion contexts, we assessed the listeners cortical tracking of attended and unattended speech and task-related attentional allocation using Temporal Response Function (mTRF) and Power Spectral Density (PSD) analyses. Behavioral comprehension of the attended narratives was uniformly high. PSD analyses showed no group difference in task-related attentional allocation, but mTRF results revealed robust differences in cortical tracking, with increased tracking of attended - but not unattended - streams in the immersed group, driven by the delta band (1-4 Hz). This boost in tracking of the attended signal declined with prolonged immersion, indicative of changes to attentional speech processing as the language environment stabilizes and consistent with the expansion-renormalization framework of neurocognitive adaptation. Jointly, these data imply that immersion in second-language environments shapes the way listeners encode speech, sharpening the brains ability to extract target auditory information from background noise. They furthermore suggest that, rather than being static or monotonous, this modulation reflects a flexible and dynamic process that is continuously shaped by changes in environmental demands and their duration. Key pointsO_LISecond language immersion boosts cortical tracking of attended speech, driven by the delta band (1-4 Hz). C_LIO_LIThis boost decreases with prolonged immersion, reflecting the dynamic, expansion-renormalization adaptation trajectory. C_LIO_LIImmersion does not influence task-related attentional allocation. C_LI
Kumar, G. V.; Lacey, S.; Nygaard, L.; Sathian, K.
Show abstract
Iconicity refers to systematic links between word form and meaning. Although evidence for iconicity in natural language continues to grow, its neural basis remains unclear. Using functional magnetic resonance imaging (fMRI) and multivariate pattern analysis (MVPA), we examined iconic shape associations of auditory real words and pseudowords. The pseudowords were matched to the real words in phonemic and phonotactic properties, while differing primarily in the absence of learned semantic representations. Participants listened to each item and judged whether it sounded rounded or pointed. Searchlight MVPA revealed significant decoding for both stimulus types. For real words, iconic shape associations were decoded above chance in regions associated with visual and haptic shape processing (left lateral occipital complex and left anterior intraparietal sulcus), visual imagery (bilateral precuneus), phonological processing (bilateral supramarginal gyri), and semantic processing (left middle frontal and right superior frontal gyri). For pseudowords, significant decoding was found in regions associated with multisensory feature organization (right posterior intraparietal sulcus) and language processing (left angular and inferior frontal gyri). Together, these findings provide evidence for neural mechanisms mediating iconic associations, with language-related areas involved for both real words and pseudowords, and visual processing for real words.
Eden, G. F.; Coutinho, M. R.
Show abstract
Prior studies have reported inconsistent results for neuroanatomical differences between early bilinguals and monolinguals. These studies primarily measured gray matter volume (GMV), involved small samples, and prioritized adults. Few studies of early bilinguals have measured cortical thickness (CT), which offers more anatomical specificity. It remains unclear whether results derived from differing metrics and approaches (e.g., vertex-versus parcel-wise analyses) converge. Using data from the Adolescent Brain Cognitive DevelopmentSM (ABCD) Study, we compared neuroanatomy between large groups of early cultural Spanish-English bilingual and English monolingual children (N = 1,209) matched on age, pubertal status, sex, handedness, socioeconomic status (SES), and nonverbal reasoning. Whole-brain voxel-based morphometry revealed areas of greater and of lesser GMV in bilinguals than monolinguals across all lobes. Vertex-wise CT analyses similarly identified widespread differences, with bilinguals showing areas of both thicker and thinner cortex. We contextualized these findings with parcel-wise CT analyses (average CT values), utilizing two atlases of differing spatial granularity. Parcel-wise results showed good correspondence with vertex-wise findings when implementing the more fine-grained atlas (Destrieux), but use of the coarser atlas (Desikan-Killiany) provided results that led to different conclusions. Finally, we tested for interaction effects between bilingualism and SES on CT and found several regions where differences between bilinguals and monolinguals in CT were modulated by SES. Together, these findings indicate that early bilingualism is associated with extensive neuroanatomical differences relative to monolinguals during childhood, and that these results can vary as a function of neuroanatomical metric, analysis approach, atlas granularity, and SES. Research HighlightsEarly Spanish-English bilingual and monolingual children differ in gray matter volume and cortical thickness across multiple brain regions. Cortical thickness differences between bilinguals and monolinguals cannot be firmly attributed to adaptations associated with language or executive control. Socioeconomic status modulates cortical differences between early bilinguals and monolinguals, revealing unique thickness patterns for those with lower versus higher SES backgrounds. Parcel-wise between-group cortical thickness results are affected by atlas choice and can influence the interpretation of the findings.
Maruo, K.; Kessler, R.; Huettig, F.; Skeide, M. A.
Show abstract
Learning to read requires linking auditory and visual information, yet how the developing brain maps information across sensory modalities remains poorly understood. To shed light on this topic we employed functional MRI to investigate hemodynamic brain responses during spoken and written word or pseudoword recognition in 61 primary school children with different levels of reading experience. Audiovisual representational similarity of activation patterns in the inferior frontal gyrus, inferior parietal lobule, superior temporal gyrus, and temporo-occipital cortex, increased linearly with school grade and this effect was largest in the left posterior superior temporal gyrus. Our results suggest that learning to read is related to a progressively increasing similarity of auditory and visual word representations within canonical language areas.
Winzer, B.; Burns, W.; Chikoti, R.; Strawderman, E.; Meyers, S. P.; Walter, K. A.; Pilcher, W. H.; Tivarus, M. E.; Mahon, B. Z.; Garcea, F. E.
Show abstract
Verbal fluency is a behavioral task that requires the generation of words from a semantic category (category fluency) or words beginning with a specific letter (letter fluency). Although word production engages a frontal-temporal-parietal network, no studies have tested how lesions to temporal and parietal lobe areas that represent semantic and phonological knowledge dampen neural responses in the left pars triangularis and the left pars opercularis, two adjacent regions in the left inferior frontal gyrus implicated in word search and retrieval. Here, 52 patients with temporal lobe lesions underwent clinical functional MRI while performing the category and letter fluency tasks. We investigated where lesion presence was inversely related to the magnitude of task-specific neural responses in pars triangularis and pars opercularis using a technique referred to as voxel-based lesion activity mapping (VLAM). We found that lesions to the left anterior superior temporal gyrus, left temporal pole, left hippocampus, left insula, and underlying inferior fronto-occipital fasciculus were associated with reduced neural responses in the left pars triangularis during the category fluency task. Lesion damage to the right hippocampus was associated with reduced neural responses in the left pars opercularis during category fluency. By contrast, lesions to the left posterior superior temporal gyrus, left supramarginal gyrus, left parietal operculum, and the inferior fronto-occipital fasciculus and left arcuate fasciculus were associated with reduced neural responses in the left pars triangularis and the left pars opercularis during the letter fluency task. These results suggest that anatomically dissociable brain networks interact with the left inferior frontal gyrus when different search strategies constrain the retrieval of word representations.
Xin, Y.; Xu, H.; Cong, F.; He, W.; zhang, g.
Show abstract
Audiovisual semantic matching can be achieved using either written words or pictures, yet whether these formats engage shared semantic matching representations with similar temporal dynamics remains unclear. We recorded electroencephalography from 27 participants while they performed audiovisual semantic matching tasks in which spoken words were paired with either written words or pictures. Stimuli included both natural and man-made objects. Time-resolved multivariate pattern analyses (MVPA or decoding), cross-decoding, and temporal generalization analyses were used to characterize the temporal dynamics of semantic processing. Reliable decoding of matching versus mismatching judgments emerged in both word and picture conditions. Decoding onset that significant above chance level occurred earlier for written words than for pictures and cross-decoding analyses revealed successful generalization between word and picture formats. Temporal generalization analyses further demonstrated distinct representational dynamics across formats, with word processing characterized by predominantly time-specific neural representations and picture processing showing more sustained and temporally stable representations. In addition, matching-related discrimination emerged earlier for natural objects than for man-made objects across both formats. The results suggest that speech-word matching shows earlier neural evidence of audiovisual alignment than speech-picture matching, potentially reflecting differences in how auditory linguistic input is integrated with visual information across representational formats.
Schug, A. K.; Gutierrez-Schieferl, I. S.; Eden, G. F.
Show abstract
Two decades of research have provided evidence for gray matter volume (GMV) differences in developmental dyslexia (or reading disability, RD) in the left perisylvian cortex. However, there are concerns about result inconsistencies, likely attributable to small sample sizes, lenient statistical thresholds, and insufficient accounting for demographic variables and global GMV (Ramus et al., 2018). To address these concerns, we conducted a Discovery and Replication Study (N=262) using data from the Adolescent Brain Cognitive Development Study. We found GMV differences between the RD and Control Groups did not replicate across the Discovery and Replication Studies using voxel-based morphometry (VBM) in Statistical Parametric Mapping (SPM), and that a more conservative threshold yielded far fewer results. We then conducted Reproducibility Studies and first found that when using surface-based morphometry in FreeSurfer instead of VBM, the Discovery and the Replication Study results again failed to converge. Second, we combined all groups in a factorial VBM/SPM analysis and the interaction analysis provided quantitative confirmation for diverging between-group difference results across the two studies. Third, we tested for the role of covariates of no interest and found that when total GMV is not controlled for, this divergence dissipates and group differences in RD (main effect of Reading Ability) are amplified. In conclusion, replication of GMV differences in RD is low, even when using large, well-matched groups, and analyses approaches play a modulating role. As such, results from prior studies using lenient statistical thresholds and not accounting for total GMV should therefore be viewed with caution.
Oak, A.; Gutierrez-Schieferl, I. S.; Eden, G. F.
Show abstract
It has been proposed that bilinguals have better executive function (EF) arising from the constant selection of one language while inhibiting the other, and gray matter has been found to differ in bilinguals in regions linked to EF (frontal-parietal and subcortical structures). Attention Deficit Hyperactivity Disorder (ADHD) is associated with poorer EF and neuroanatomical differences underlying EF. Given the EF advantage in bilinguals, we investigated whether a bilingual experience affects EF performance and brain structure differentially in those with ADHD. Using the Adolescent Brain and Cognitive Development Study, we compared early Spanish-English bilinguals and English-speaking monolinguals with and without ADHD. ANOVAs for the Flanker, Working Memory, and Card Sort Tasks revealed no main effects of Language Experience (Bilingual versus Monolingual), a main effect of Diagnostic Group for Card Sort (ADHD worse than Controls), and no interaction effects on performance for any task. ANOVAs for gray matter volume (GMV) revealed a main effect of Language Experience in many regions, a main effect of Diagnostic Group in some regions, but no interactions. GMV in left thalamus was affected by both ADHD and bilingualism, but the effect of ADHD was not significantly diminished or enhanced by the dual-language experience. For cortical thickness, there was a main effect of Language Experience in several regions, no main effect of Diagnostic Group, and no interactions. Taken together, bilingualism has some impact on EF performance, a strong impact on neuroanatomy, but there was no disproportionate impact by bilingualism on the differences caused by ADHD for any measure. Research HighlightsExecutive function and brain structure differ in ADHD and in bilinguals, prompting the need to investigate interactive effects. Bilingualism did not disproportionately affect performance differences in ADHD for executive function, nor for gray matter volume or for cortical thickness differences in ADHD. Gray matter volume was less in ADHD than non-ADHD, as well as greater in bilinguals than monolinguals in the left thalamus, but without interaction effect. These independent effects indicate that the brain basis of ADHD is not impacted by a dual-language experience.
Ozker, M.; Giglio, L.; Beyh, A.; Forkel, S.; Hagoort, P.
Show abstract
Sensory feedback is essential for the fine-tuning of motor actions, and speech production is no exception. It depends on continuous self-monitoring to ensure that produced sounds match intended targets. Delaying auditory feedback (DAF) disrupts this alignment and impairs fluency, providing a powerful tool to investigate sensorimotor control. We combined functional and diffusion-weighted MRI in 31 participants performing a word-production task under delayed (DAF) and immediate (no-DAF) auditory feedback. While all participants slowed their speech under DAF, the extent of this effect varied across individuals and was quantified using a susceptibility index (SI). At the group level, DAF elicited increased activation in a right-lateralized network encompassing the superior temporal gyrus, supramarginal gyrus, inferior frontal gyrus, supplementary motor area, and left cerebellum. Incorporating individual differences revealed that higher susceptibility was associated with greater activation in left-hemisphere speech motor homologues and larger volume of the right long arcuate fasciculus, a white-matter pathway connecting auditory and motor speech regions. This pattern suggests that vulnerability reflects increased recruitment of neural resources and a stronger reliance on auditory-motor coupling. In contrast, resilience was associated with greater engagement of the bilateral angular gyrus and higher fiber density in the right posterior arcuate fasciculus, which connects auditory and somatosensory speech regions. This finding indicates that resilience is supported by a posterior circuit that efficiently integrates multi-modal sensory feedback. Together, these findings link functional dynamics with underlying structural connectivity to reveal how a right-lateralized network supports speech control, while accounting for individual differences in susceptibility to fluency disruption. Significance StatementFluent speech depends on the brains ability to monitor self-produced sounds and sensations from articulatory organs to adjust motor commands in real time. To uncover the neural basis of this process, we combined a fluency-disrupting paradigm, delayed auditory feedback (DAF), with functional and structural neuroimaging. This multimodal approach revealed that while DAF processing relies on a right-lateralized network, more susceptible individuals show enhanced recruitment of left-hemisphere monitoring regions. We also found that stronger white-matter connections in the right posterior arcuate fasciculus predict greater resilience and fluency. These findings provide an anatomically grounded account of how auditory and somatosensory feedback interact to support speech production, offering new insight into why some individuals are more susceptible to fluency breakdowns and related disorders.
Xie, Z.
Show abstract
Speech perception often takes place in environments with competing sensory inputs, both within the auditory modality and across modalities; for example, following a conversation in a noisy cafe while simultaneously reading a menu. This study examined the extent to which dividing attention between auditory and visual modalities (bimodal divided attention) influences linguistic context processing across hierarchical levels during continuous speech perception in noise. Electroencephalographic (EEG) responses were recorded while participants listened to audiobook stories in multitalker babble as a secondary task, concurrently performing a demanding primary visual task that imposed either low or high cognitive load. Behaviorally, speech comprehension accuracy was significantly lower under high-load than low-load dual-task conditions. Multivariate temporal response function (mTRF) encoding models were used to predict EEG responses from information-theoretic measures (entropy and surprisal) indexing linguistic context at sublexical, word-form, and sentence levels. Significant neutral tracking was observed at the word-form and sentence levels, but not the sublexical level. Critically, neutral tracking of sentence-level linguistic representations was significantly reduced under high compared to low load, with effects emerging at latencies beyond 200 ms. In contrast, neutral tracking of word-form-level representations was unaffected by dual-task load. mTRF analyses further revealed that neutral tracking of acoustic features was not modulated by dual-task load. These findings indicate that bimodal divided attention selectively disrupts cortical representations of sentence-level linguistic context, while lower-level processing remains relatively preserved. Such impairments in higher-level linguistic processing may contribute to reduced speech comprehension during multitasking in noisy environments.
Dorsi, J.; Lacey, S.; Nygaard, L.; Sathian, K.
Show abstract
Iconicity in spoken language refers to the mapping of speech sounds to meaning. For example, the pseudoword "bouba" is judged to sound rounded, whereas the pseudoword "kiki" is judged to sound pointed (Ramachandran & Hubbard, 2001). Recent work has found systematic relationships between speech acoustics and iconicity ratings in various meaning domains, including shape. To control for confounding by semantic knowledge, much research on iconicity relies on pseudowords. However, the role of iconicity in conveying the meanings of real words is still poorly understood. Here, we compared the relationship between speech acoustics and shape iconicity ratings for both pseudowords and real words. In this experiment, participants rated real words and pseudowords for how rounded or pointed they sounded. We compared the relationship between 12 acoustic parameters and the rounded/pointed ratings for both words and pseudowords. We found that the correlations between these acoustic parameters and the ratings were similar for real words and pseudowords, providing key evidence that iconicity of real words is linked to speech acoustics.
Bahar, N.; Arabadzhiyska, D.; Jones, H.; Singh, S.; Davis, M.; Ricketts, J.; Ripolles, P.; Krishnan, S.
Show abstract
Contextual word learning is a fundamental mechanism for vocabulary acquisition during childhood. In adults, successful inference of word meaning from context is intrinsically rewarding, and is associated with greater enjoyment and greater activity in reward-related brain regions. Whether similar reward mechanisms support word learning in children, and whether they differ as a function of ability, remains unknown. We used functional magnetic resonance imaging (fMRI) to examine neural responses during contextual word learning in 25 children aged 11-13 years with typical reading skills and in 20 age-matched children with dyslexia. Neurotypical readers showed enhanced activation in core reward-processing regions, including the ventral striatum, when successfully learning the meanings of novel words. In contrast, children with dyslexia did not exhibit comparable reward-related responses despite performing the same task. Crucially, this group difference was specific to word learning, as no significant group differences were observed in ventral striatal responses during a non-linguistic monetary reward task. In addition, to confirm the behavioural relevance of these neural findings, we examined an age-matched, independent sample of children. We found that stronger reading skills were associated with greater enjoyment during successful word learning. Together, these results suggest that interactions between reward and language systems during contextual word learning is influenced by reading proficiency. Reduced intrinsic reward responses to successful language learning may contribute to differences in reading development and have implications for the design of more engaging and effective reading interventions for struggling readers.
Rizzi, R.; Stirn, J. R.; Eisenhut, Z.; Bidelman, G. M.
Show abstract
Listeners discretize the speech signal by assigning sounds to phonetic categories, though there is variability in how individuals accomplish categorization. Having more consistent categorization of sounds may be advantageous for understanding speech-in-noise (SIN). Though, it is unclear how different levels of neural processing in the auditory system reflect these perceptual differences. We recorded brainstem frequency-following responses (FFRs) and cortical event-related potentials (ERPs) while listeners actively labeled vowels along an acoustic-phonetic continuum using a visual analog scale. We computed intertrial consistency of neural responses to index the stability of listeners' neural speech representations across stimulus presentations. We also assessed how faithfully midbrain and cortical responses represented stimulus acoustics using representational dissimilarity matrices (RDMs) computed across all token pairs. Neural RDMs were then compared with acoustic and phonetic category RDMs to assess whether FFRs and ERPs carried gradient vs. categorical information of the speech signal. We found greater behavioral consistency during phoneme labeling was correlated with improved SIN scores. Neurally, we found greater cortical or subcortical consistency predicted greater behavioral consistency. RDMs revealed subcortical responses retained more acoustic details, while cortical responses more closely reflected abstract phoneme categories. Our findings reveal important benefits of perceptual consistency to other domains of speech perception. We find perceptual consistency is driven by more consistent encoding of speech at either a cortical or subcortical level. More consistent sensory processing could provide a more stable readout of the speech signal to higher cortical brain areas which could confer advantages to later perceptual processes downstream.